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article were also identified, and the reviewer attempted to determine 
whether a theory base had been used. Conclusionj^J/ncluded the 
following: most studies employed pencil and paper instruments 
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Changes in Types, Topics j and - Methods Employed in 
College Student Research Between 1969 and 1983 

Systematic reviews of the research on college students have been 
conducted periodically (e.g., Jacob, 1957; Feldman & Newcomb, 1969}." 
Such reviews have succinctly summarized what is known about the growth 

v " : . ;"! ' "f; 

and behavior of college students at a particular point in time and have 
also suggested areas in which further research would be useful. Many 
issues related to college., student research are typically not addressed 
in such reviews. For example, to what extent do the topics studied 
and methods employed change over time? For examp le, ^ vere more article^ 
focused on minority an^ commuter students published in tl^e 1980s 
compared with the 1970s ?f Has there been^a shift from the use of 
descriptive methods to analytical techniques? ^ f 

\^ The purpose of this study is to describe the methods used and 
substantive topics addressed in various kinds of college student re? 
search published between 1969 and 1983. t The following question? 
guided the study: % 

(1) Have the types of college student research reported in 
selected journals changed between 1969 and 1983? 

(2) Have the substantive topics appearing in these journals 
changed? 

(3) Have the methods used in the study of college students, 
changed during this period? ^ 

(4) Do particular journals exhibit a preference for certain types 
of college student research? « * 

/ . : 



ymy/y^ 



7. 




i 

*/ ; / r \V/'\. ' *' ) v : \ v . Perspectives 

To analyze the college student research/ a framework was needed 
within which contributions to the literature could be' classified. 
Two perspectives were used to develop the framework: knowledge classic 
fication- schemas in general; and (2) knowledge production rela^BP^^ ' 

college students. . N > . 

.'*.'•••* * •• ■ ' * '■ - ' V 

Knowledge Classification Schemas ■ 

The status and social utility of a field of study can be estimated 
in different ways; e.g.- the number and quality of scholarly publicai 
tidns devoted to* the field-, the field's contributions * to society J 
chronicled in its publications and in the popular media, and the extent 
to which personnel in allied fields use the information and innovations 
developed by the field. One rationale fo]r the importance of college 
student research J.s that faculty and student services staff familiar 
with students' changing characteristics and 'needs will better under* 
atand their constituents, / and will therefore be more effective 
(Stamatakos, 1981; Wilensky, 1964) ./ r . 
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Developing a typology of the knowledge produced in a . field 
an integral step in understanding that knowledge. Typically, thT 
advance organizer or guiding principle in a knowledge typology is 
"intended Use of knowledge" such as drawing conclusions, developing 
policies ffknd^synthesfzing concepts (Culbertson, 1977; Kellaqas, 1975). 
Knowledge typologies can also be used to estimate tfte J| Hp* o^d^P - 
ftutions ijo a field. For example. Silverman ( lpwBMBpiedgfchat the 

skie of /a scholarly contribution at a specific point in the develops 

/ ■'■ i - 

■/''■* ' i ^ 

me^it of | a field will be best understood by considering the methodot 




logical* approaches used by the Inquirer and the kin3 of information 
with which the inquirer is dealing. ~- 

Silverman demonstrated this notion using a four celled typology 
developed by Mitroff and Kilmann (1978). In this typology, t-b'e 
analytical scientist" represents an aloof, objective inquirer with an 
/acknowledged preference far quasitixperimental methods* In contrast, 
t.he "conceptual humanist'* recognizes the importance of the subject's 
interpretations of reality to -knowing" and attempts to get close to 
and- appreciate the subject's affective response to an event to more 
fully understand, the behavior oxf event under investigation. 

The conceptual humanist and the analytical scientist approach the. 

<* - ; , - . 

subject of the inquiry differently; therefore, the phenomena they 
observe and the way in which they interpret their observations are 

* likewise different. According to Silverman it is Important for a field 
to periodically assess whether certain perspectives are\ favored by the 
scholars contributing to a field to determine whether systematic , but 
unrecognized biases may be influencing the information disseminated to 
the consumers of knowledge in that field. 

As a field of study evolves over time, the types of knowI^J|e 
produced and the methodological techniques employed to produce 
knowledge are likely to become more sophisticated. During the nascent 

^development of a field, or a period of rapid change in the field's coi»~ 
activities, a disproportionately large number of descriptive studies 
usuaily appear. In the former instance, such profiles serve to delimit 
the boundaries of a flfeld; in the latter, descriptive information is 
used by practitioners as a barometer -of changes in standard practices 
in the field. Borrowing methodological advances from allied disciplines 



improves the validity of precepts and assumptions on which the field is 
based. For example, theories about college stu den t behavior can be 
rigorously examined * through the use of multivariate techniques 
developed in such fields as sociology and psychology. As the knowledge 
base of the field expands, syntheses of earlier descriptive contribu* 
tions and analytical frameworks appear with increasing frequency (c.f.* 
meta analysis). An important function of a knowledge synthesis is to 
identify trends in practice , and to reexamine .assumptions on which 
certain practices of a field. have been grounded*. 

College Student Knowledge Production • ' 

Interest in the behavior of college students "ckn be traced in one 
fqrm or another to the beginnings of the university as. an institution 
in modern society" (Parker, 1978, p. 3). However, since the late 
1960£, the number of theories describing students- intellectual and 
social temotional .development during the college years has increased 
almost exponentially. Just 'as Jacob's (1957) 'landmark "Volume sodw^L 
a. multitude of descriptive studies of college students during the 

1960s, the contributions of Chickering (1969), Erikson, (1968), Perry 

"• * / ' A si 
,(1970) and Sanfortf (1962) werp j^arbingers of a 4ecadr f thed^p dev^jp 



opment during the 1970s* Cur i tint iy, numerous models and theoretical 



formulations exist which represent careful datafbased efforts to des4 



cribe college student behavior from a developmental perspective (e.g., 
Cr*oss,^ 1976; D. Heath, 1968; R. Heath, 1964; Hunt, 1970; Kohlberg, 
1975; Levinson,1978; Vaillant, 1977). In addition, in the 1970s, Vwo 
new journals have appeared which feature papers reporting rese^'^h on 
college students, Research in Higher Education and Review , oi Higher- 
Education. Also^ the Journal of College Student Personnel which is 



devoted almost exclusively ,to papers reporting some aspect of ^the 

' •'• • • • ' ' A • 

college student experience Jias iiuirerfsed the number of volume pages by 

about 20% since the late, 1960s. V/hile the "college student* l'itexatnre 

is now mord voluminous, ^riche*,' and more differentiated, scholars and 

practitioners alike must grapple vith the attendant problems identified 

by barker, Widick and Knefeljcamp (1978): "(1) how to keep up with the 

knowledge explosion; (2) ^ow to make sense of^ttfe many models; and (3) 

after understanding them, how to translate them ijito useful aria helpful 

tools... "( p. ix). * 

..' * ■ * ' 

Related Literature 



Attempts have been made to classify knowledge produced in in areas 

^ * *■ 

of professional service related to college students. For example, Kuh 



and Bursky (1980) developed^a^^m^^jyith four categories (philoso* 
phical/theoretical , research^f^Euation, literature review, program 
description) to' determine the frequency with which certain types of 



articles appeared in four student affairs journals ( Journal of College 
Student Personnel* * JCSP , National Association of Student Personnel A j minis + 
trators Journal* fNASPA , National Association of Women Deans , Administrators 
and Counselors' Journal t t NAWD AC ? Personnel and Guidance Jo^irnal+i P&G ) 
between 1970 and 1978. This schema was intuitive rather than derived 
emprically synthesized from the extant knowledge production literal 
ture. In the same field, Hood, Hull, and Mines ( 1983) , estimated the 
extent to which one journal, JCSP , published information relevant to 
specialty areas within student affairs work (e.g., residence life,* 
admissions, orientation, etc.). 

Another illustration of analyzing the material published in a 



• * ' ' v * H ' :" ' - . .. - 

^ sdholarly journal is Hayes antf Kenney's (19830 use bf popular social 

• - •* ' * * ■ y. - ' 

sciences research designs to categorize, the \counsellng psychology 

i « ' ■ * • ? ^ ' " 

research.' They^ reviewed and classified the articles appearing in the k 
Journal * af Counseling Psychology ( JCP ) between 1954 and 1980 int^ one » 
V of four categories: (1) mechanical mirrorf-la <;oatrolled 'experiment in 

which the investigator assumes. an objective posture; (2) psychoanaly* * 
tlcttthe investigative mode is intuitive interpretation; (3) organic 
lampttusing the scientific .canons cff field work (e.g., ethnography),- 
the investigator purposefully interacts with the subjects to record 
behavior from an In situ perspective; and (4) eclectic* ^elements of two 
or more of the abdye approaches are combined. Hayes and Kenney found a 
preponderance of "mechanical mirror" entries in JCP during this period 
and ^also noted that subtle shifts occured irithe proportion of the 

. - - < %v 

kinds of articles published when editors changed. These inquiries were 
not- focused specifically on the literature describing college student' 
behavior and development* They served to update the members* of the 
journals' sponsoring associations * about the nature of th£ material 
appearing in the respective periodical. 

Several efforts have been caade to synthesize the various models or 
theories of college student development. Parker et al.(1978) developed 
five theory clusters in which extant models ~fcould be categorized: 
psychosocial, cognitive tdevelopmental , maturity / typology, and person* 
environment interaction. Rodgers (1980) offered a somewhat different 
schema: cognitive developmental, psycho i soci al , person*environment - 
interaction, humanistic existential, and human development process 
models. No systematic effort -has been made to document the changes in 
the kinds -of empirical research conducted to verify theories of student ^ 
behavior. Nor has an effort been made to describe researchers' methot 
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dological and ; substantive preferences in the published studies on 

college students. To accomplish these tasks, a typology is needed to 

codify these different kinds of research. 

* ■ ■ > ■ - 

>A Typology For 'synthesizing College Student Research * 

To categorize the research about college students published be* 
tween.1969 and 1983, a knowledge schema developed by Bradley, Coomes 
and Kuh (1983<P, ¥ synthesized from extant typologies developed by 
Culbertson (1976), Kellams (1975)^ and Silverman (1982), was used. The 
Bradley et al. schema has six categories. 

(!) Descriptive articles sort or arrange information about college 
students into meaningful categories for visual or statistical 
comparisons. However, prediction, hypothesis generation, theory 
development and/or policy implications are either not included or 
receive .only cursory attention. 

(2) Theory development articles aim to establish causal relation* 
ships among sets of variables or to test models based on principles 
directly derived from observation or referejj^ce to .other theoret^^. 
formulations. The distinction between this type of inquiry and others 
is the intended generalizability of results and the prediction of 
behavior across a wide range of settings. 

(3) Concept integration papers produce new knowledge about college 
students through analysis and integration of existing ideas. Data are 
usually collected frQm multiple sources such as literature reviews and 
case* surveys and are analyzed through sifting, classifying, and differ* 
entiating pertinent variables. 

(4) Policy formulation articles describe how policies related to 



student behavior^ in institutions of higher education are' created, the 
manner in which 'policy is enacted by institutional agents, and how 
policies related to student life can be modified and improved. 

(5) Decis ion vma king articles provide information to assist insti* 
tutional agents in evaluating curriculum and student life programs and 
personnel and often takes the form of summative evaluation strategies r , 
program reviews, and personnel and program evaluation^A 

(6) Developmental papers include detailed descriptions of innova* 
tions in areas ,such as curriculum, residential living environments, and 
faculty mentoring or peer assistance programs designed 'to enhance the 
quality of student life. Characteristics of developmental inquiry 
typically include field testing and the use of strategies such as media 
or formative evaluation by institutional agents to solve particular 
problems or attain institutional purposes. 

Methods 

The RAND Case Survey Method (Yin & Heald, 1975) was used to* guide 5 
the development of the instrument and data collection. Case, survey 
methodology was originally designed to gather information from existing 
documents in much the same way. an interviewer uses & structured protot 
col to collect information^ ron^ an interviewee. In this study, .each 
relevant article was considered a case* One of five Reviewers read 
each of the articles and completed a questionnaire developed for the 
purpose of analyzing the article. 

Ins trumen t a t ion 

. The primary data' gathering tool was the College Student Research 
Case Study Questionnaire (CSRCSQ). The final version of the instrument 

8 11 



was subdivided into four sections. In Section I, pertinent information 

" ' ; , ■ • ' . ' \ ' £, ■ ' , * 1 r 

about the articlfe was recorded (i.e., -journal source, year published/ 

is^ufe number, number of male and female authors/ and mumber of articles 

v. * . . „ ' *' . . 

appearing in the. respective issued , . ' 

. lE^section II, the extent to which one or more substantive topics 

were addressed in the article- was noted. Five "ma jor categories were 

used within which topics were grouped: 

CI) Behavior* * achievement, admission/matriculation, alcohol/ 

drugs attrftion/persistenqe/retention, academic dishonesty, sexual 

activity/preference, and student activities including participation in 

student government and other leadership functions; 

(2) Selected characteristics* taptitude , vocational and 
educational aspirations and interests , att'itudes/perceptions/expecta* 
tions, commuters, educationally disadvantaged, foreign, fraternity/ 
sorority, graduate/professional, handicapped, health/suicide, ethnic 
group (race, religion), older (25 years of older ), personality charac* 
teristics/functioning, ' socioeconomic status (SES), transfer, veterans, 
and women; 

(3) Student development* ♦career/vocational, cognitive/ 
intellectual, moral/ethical, social/emotional; tt 

(4) . Instruction * *developmehtal/remedial/cbmpensatory /study 
skills, evaluation of instruction; and 

(5) Miscellaneous * *f inances, learning styles/preferences, 
liv^pg environments /campus ecology/ student*f acuity interaction, 
students' rights/lega\ -issues/discipline, and an "other" categoty. , 

The rater was to determine whther the substantive topic was the 
primary focus of the article .(i.e. , the article title, conceptual 




framework and data gathering tools and technique^ address y^tie topic 
which is of ten- conceptualized as the independent 'variable) , t^e sec on* 
d^ry focus (i.e., the article includes or mentions the topic or varia* 
but is subordinate to one or more primary topics or independent 
variables), not, included , ot uncertain as to how to code the topic. 

Sectiqjji III of the CSRCSQ was divided into t^hree^a tegories . For 

» * * 

each article, the following sample characteristics were recorded: the 

site of the investigation (i.e., single institution, multiple institu* 

■ * - 

tions, national,, uncertain, or not applicablef #NA; institutional sup* 
port (i.e., public^ private, both, uncertain, NA) type of institution 
(community college/vocational-ttechnipal, baccalaurate , masters level, 
doctoral granting, multiple Institutions, other^or NA); total analyzed 
sample size (in the event two or more experiments or studies were 
reported in the same article, the sample sizes were "pooled" to 
determine the total analyzed sample size), participants' gender, and 
whether the sample was comprised of an ethnic group. 

The kinds of data collection methods ' and sources of data employed 
in *each article' were also noted: standardized or locally developed 
pencil and papfer Instrumentation, interview, observation, field or 
laboratory experiments, document analysis (academic transcripts, test 
sc'ores, etc.), review of published or fugitiv^ literature, anecdotal, 
and "otter". \ • ■ . - 

third subsection addressed the design and an alytical techniq ues 
employed 'in the article: , descriptive (e.g. , frequencies, mean, etc.), 
^univariate, multivariate, reliability estimates, data reduction (e.g., 
factor analysis, cluster analysis, etc.), other, statistics , .and thie 
design of the stu^y (i.e. , longitudinal, cross sectiohal 'or a combina* 
tion of the two). ' '~ 



The final section of the CSRCSQ requested tt\e reviewer to deter* 
mine the type of article using the categories' developed by Bradley et 
al. (1983) described earlier. Because articles could conceivably 
encompass elements of several categories, ^the following coding system 
was used: (a) primary thrustff elements of this category dominate and 
the paper was developed primarily if not exclusively with this purpose 
in mind; (b) secondary thrust tfthe' paper reflects elements of^ a 
category which are complimentary but secondary to elements/charactferis* 
tics of another category; (c) uncertain. In addition, the reviewer 
attempted to determine whether a theory base had been used to develop 
the arguments state the <problem and/or interpret the results. 

Data Sources 

a 

The analyzed articles reported college student research or^ome 
aspect of student life and appeared* in the following periodicalsf^ 
American Educational Research Journal ( AERJ )«» Journal of College 
Student PerstinneJL ( JCSP ), Journal of Counseling Psychology ( JCP ) , 
Journal of Educational Psychology ( JEP ) , Journal of Higher Education 
( JHE ) , National Association of Student Personnel Administrators Journal 
( NASPA ) National Association of Women Deans , Administrators , and 
Counselors Journal { NAWDAC ) , Personnel and Guidance Journal ( P&G ) , 
Research in Higher Education ( RHE ) , Review of Higher Education (RevHE) 
and Sociology of Education ( SocE ). These journals were selected 
because' they are known to publish research or other types of papers 
describing the college* student experience, and are refereed thereby 
suggesting some degree of quality control over what is published'. All 
articles in all issues of these periodicals from every other volume 



year beginning in 1969 through 1983 were reviewed. Letters to the 
editor, research notes, book reviews, editorials and similar 
information were not included. y 



Procedures 



— Using the procedures suggested by Yin and Heald (1975), k the ver* 

sion of the the CSRCSQ used to collect the data was revised several 

times aft^* pilot tests. The first draft was developed based on convert 

t 

satigns with several -college student researchers and the Bradley et al. 
schema. This ' version, was critiqued >by the other members <f£ „ the 
research team, revised, critiqued again and revised once more before 
the reviewers used the instrument to collect information from sample 
cases. Four articles from three journals spanning the period covered 
by the study and representing different types of papers (e.g., descrip* 
tive>^^eory development, etc.) were selected to field test the CSRCSQ. 
After each reviewer independently used the CSRCSQ with each article, 
the reviewers discussed their experiences and findings, and' made 
suggestions for improvements in the CSRC$Q. After th^s discussion, 
another version of the instrument was prepared. Each reviewer was then 
assigned to review articles in specific volume years for certain jour* 
nals. To increase reliability of reviewers' ratings, the reviwers met 
weekly tb report their progress and to discuss particularly troublesome 
cases. All of the articles were reviewed within a six week period. 
, Five members o£ the research team revijgwered articles, two 

"faculty and three higher education doctoral students. All of the 
reviewers had previous experience in conducting and publishing research 
on college students. 

for each major CSRCSQ subsection (i.e., substantive topic, sample 

' 12 



characteristics ,' data collection ', design and analytical techniques, and 
type of article)', reviewers indicated their level of confidence (foigh, 
modetate, or low) in the category rating. Indicating the cettainty of 
the reviewer s confidence in the ratings permits ratings in which 
investigators have limited confidence to be, omitted, from certain 
analyses of the data thereby potentially increasing the, reliability of 
the findings. 

According to Tinsley and Weiss (1975), the most appropriate 
statistic for estimating interrater agreement on nominal data is 
Cohen^s kappa. However, this statistic cannot be calculated for three 
or more raters reyiewirig the .same article. . The only meaningful estii 
mate of interreviewer agreement known to the authors for , use with 

multiple raters of nominal data is the proportion of items on which 

t ■. 
reviewers agreed (Pttsame identical rating). .Therefore, P was computed 

for nine common articles or cases, four reviewed at the begining of the 

study and the 30th article reviewed by each reviewer which was 

subsequently duplicated and reviewed by the other four reviewers. This 

was expected to result in a relatively conservative estimate because 

reliability usually increases as reviewers become more familiar , with 

the instrument and the material being reviewed (Yin & Heald, 1975). 

For the first fou^cases, P ranged between 88.7% and 93.5% per case; 

for the second group of five articles, P ranged between 91.5% and 96.3% 

The overall level of agreement^ for the nine articles for which P was 

computed was 93.2%. 

This study. was primarily designed to classify and describe research 

about college studerttfs. Therefore, not all the articles in which 

college students wew used as- subjects^ or data s^^tes wefe / eligible 
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for Inclusion. Th^ reviewers were instructed to omit articles which 
may .have used college students as subjects but which did not, in the 
introduction, statement of the problem, theoretical framework, or dis* 
cuss ion , sections, emphasize how the study would add to, understanding 
"about college Vgudents . For example, an article about information 
■jiVocessing using college students as subjects would only be Included if 
the articTe indicated how the findings could be used to better under* 
stand* college student behavior, not information processing behavior. 
This resulted in some -difficult inclusion* exclusion^ decisions for the 
reviewers. £he principle followed was to err in the direction of 
inclusio^^v v/fhe reviewers also'had the option to indicate as part of 

the cases 1J) JJt^ they were uncertain whether the article^met the criteria 

'"."•'"i'tf ' ■ - 

for inclus^jcm, so that such articles could be excluded if desired from 

, " c - ■ $f V 

subsequent analyses. ' . ^ 

... 1 

-Ofata Analysis 

^ — r/t ' 

^^De^criptive statistics were used to develop a profile of the type^ 
o^ r ai?£ifcle published, substantive topics, and methods by year of publi* 
^ J .oii for^each periodical. Chi square analyses were used to determine 
s. ocurred between 1969 and 1983 in- certain article character* 
f the type of article, substantive topics, and methods 

v r 

in various journals). Responses about which the reviewers 
wexe ' uncertain were purposefully omitted when the data were analyzed; 
therefore ns vary depending on the variable. 

* Results 

< » 

•* * 

A total of X189 articles were reviewed,- about 26.6% of the 4467 
articles that appeared in, the 11 journals every other calendar year 

' ' 14 Hi 17 




1969*1983 inclusive* While the number of papers published in these 
journals has remained relatively stable since about 1973 (the first 
year of RHE ) , the numbac^f articles devoted to college students that 
appeared during this perifrd decreased from 175 in 1973" to 119 in 1981 
(Table 1). Much of the decrease can be attributed to fewer articles 
about college student^ published fn JCSP, JEP , JHE and JCP. The number 
of female contributors— increased while the number of male contributors 
decreased between 1969 and 1983. 

JCSP contained the largest share of articles about college stir* 
dents (30.8%) followed by JCP (10.5%), P&G (9.8%) , NAWDAC (9.6%), NASPA " 
(8.7%), RHE (8.1%), JEP (8.0%), JHE (6.5ff), AERJ > ( 3 . g% ) , SocEd (3.5%), 
and RevHE (.8%) (Table 1). This rank ord^er changed^when the proportion 
of articles each journal devoted to college student research was 
considered: JCSP (60.9%), NA^AC (44.0%), NASPA (41.2%), RHE (38. 21), 
SocE (^4.3%), JHE (22.2%), JCP J 20. 5%), RevHE (19.2%), AERJ (16.8%), 
and P&G (13.2%). \ 4 



Insert Table 1 about here 

.. v " • 

Sixtyf three percent of the articles using students as subjects 
were conducted at PhD granting institutions. The next largest group of 
subjects came from multiple institutional sites (14.6%). SocE and AERJ 
were more likely to publish articles with national samples (16.7% and 
11.4% respectively) . Samples drawn from multiple institutions were 
used most frequently iiyfflpers appearing in RHE (28.1%), SocE (19%)/ 
and AERJ ' (13.3%) (x -3WiJ4, df=30, p < .01). 

Only about f ive jfeercant of the articles were based on students 



from primarily baccalaureate granting or community colleges. Almost 
fourififths (78.5%) of the studies were conducted at state, supported 
institutions, 12% at private colleges or universities with the remain* 
der drawing samples fram both types of schools. 



Combined gender samples dominated (81.9%)r about, 10% of the 

r 

articles focused on women only and 7% on men. Female*only samples 

articles were more likely to be used irr articles published in NAWDAC , 

2 ~ 
J£SP , and, JCP fx =405.22, df=40, p < .01). Male focused articles ap* 

* pea red more frequently in SocE (14.3%) and JCP (13.6%) during the 

earlier^ years included in this study. In ilact, the number of male 

focused articles decreased between 1969 and 1983 while the converse was 

true for women. Only 73 articles (8%) used minority students exclu* 

sively when selecting the sample or compared minority students with' 

white students. 

Of' the 792 articles that were based on data gacaered from respond 
dents, only 31 studies were published based on 25 or f^wer respondents, 
aiid 64.6% used samples ^ranging from 26 to 500. Certain - journals 
exhibited a preference for studies using large samples (500 or more 
respondents): AERJ , (42.2%) / SocE (40.5%) , RHE (37.5%) , JEP' (25.3%) , 

• " ~~2 . : ~' . • •'" 

JCSP (20.5%) (x =463.54, df =80) . Ninety six percent of the sample 
ratings were reported by reviewers to be in the high confidence range. 

Pencil and paper instrumentation dominated as almost 6Q% of the 
articles used locally developed (27.9%) , standardized (24.8%) or both 
(6.1%) typ^s of instruments. Standardized instruments were more popu* 
la'r in the earlier years of the petidd studied. For. example, in 1969 
and 1971, 65.8% of the instruments used were standardized. In 1981 and 
- 1983, however, only 50.7% of the instruments used appeared to be stan* 
dardized. Observation was rarely used as a data collection technique 

16 19 



(1.6% of the articles). Interviews also were not used often (6.7%) and, 
like standardized instruments , were somewhat more popular in the ear* 
lier years. JCP and JEP published a disproportionate share of articles 
in which experimental conditions were established. Twenty eight percent 
of the articles published in 1969 used anecdotal information contrasted 
with only 16.6%, 10.9% and 13.1% in 1979, 1981 and 1983 respectively. 
Anecdotal information appeared most often in NASPA (54.4%), NAWDAC 
(41.2%), and JHE (26%). Literature reviews were most popular as a data 
collection technique in NASPA (35.9%), P&G (19%), and NAWDAC (15.8%). 
Ninety six percent of the data collection techniques ratings were 
reported in the high confidence^ range . 

Close to 60% of the articles used descriptive statistics either 
exclusively" or in concert with other techniques. This proportion 
remained fairly constant over the 15 year period. Univariate analyses 
were also fairly common (44.9%). Multivariate techniques were used in 

about a fifth of the articles* (19 .2%) and became more popular in the 

2 • , 

late 1970s and 1980s (x -33.55, df=*7, p < .01). In 1969, only 10.8% of 
the 'articles reviewed used multivariate procedures; by ISS^f almost^0% 
employed some multivariate technique. Relatively infrequent use was 
made of reliability estimates and data reduction techniques Such as 
factor or cluster analysis (about 6% of the articl^fi^u^4d one ' or the 

other). Reliability measures were employed more often in the later 

2 

years (x =23.75, df=*7, p < .01) and in articles published in AERJ 

2 - 

(22.2%), JEP (16.8%), and RHE(14,. 6%) (x =75.14, df = 10, p < .01). 

As Table 2 indicates, certain journals ( AERJ , JCP , JEP , anji RHIp 
exhibited a preference for papers using multivariate procedures. Data 
reduction methods were most often used in articles appearing in AERJ, 



JEP , and RjjEU * 



Insert Table 2 about here % 



Although the majority of studies employed crossectlonal designs 
(74.0%), longitudinal designs were used with greater frequency In later 
years (x =31. 52, df=l4, p < .05). Many of the studies categorized as 
longitudinal were field experiment^ *~elat ly jii.a duration. 

Again, reviewer^ reported level of confidence in the design ratings 
was quite high**93.5%. y 

Reviewers determined that approximately 27.2% of the articles used 
t\^ory in the conceptualization of^t]ie_s4;udy or in some other way 
(e.g., interpreting the results). This finding should be interpreted 
with caution ars this item had the lowest reliability estimate (84.4%) 

4 

wfyen, the nine common cases were evaluated. 

The single most researched tojpic between 1969 and 1983 "* was « stu* 
dents' ^attitudes and expectations including reports of satisfaction 
with college (Table 3). Ottier topics receiving considerable attention 

i 

(100 articles or more in which the substantive topic was primary or 
secondary) included: achievement / personality characteristics or func* 
tioning, campus environments, educational afid vocational aspirations, 
women, and career and vocational development. The miscellaneous 
"other" category accounted for a substantial number of entries. In the 
earlier years (1969*1973), the reviewers noted that many of these 
articles focused bTT^Btudent protest (e.g. , characteristics of involved 
students, institutional policies for dealing with campus slt*lns, 
etc.). In the later years, athletics and collective bargaining were 

"': v ' ' ' • - ■ ' ■ 
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popular topics. 

K - ■ ■ 

Over the 15 year period, some topics received more attention than 
others. Articles focused on women and older students increased in' 
number while statistically significant decteases were noted for papers 
addressing aptitude, aspirations, graduate students, and fraternity/so* 
rority members. Although only three percent of the total number of 
articles published focused on blacks, t^ey were the most oftfcn studied 
minority group with half of ail minority grouptf ocused articles. 

Insett Table 3 about he^e 

Certain journals published more articles dealing with certain 
topics. For example, aspirations and K interests cofoprised^ a, 
disproportionate share of articles in RevHE (30%), SocE ^(21.4%) , and 
JCP (20.8%) (x -77.80, df=20, p > .01) and achievement in AERJ,JCSP^nd 

2 , ? > : . 

JEP ( x =105.37, df=20, ' p > .01). ¥ In fact , over' one quarter and one 

thi^d of the college student papers published in AERJ and JEP respect 

tively were achie\^gientf^ocused. Articles concerning students' atti# 

tudes appeared most of k ten in^ JCSP (41.8%)/ SocE (28.5%), RHE (25%), 

2 

and NAWDAC (15.8%)^ (x -139.10, df=20, p > .01). Thirty six percent of 
the 91 articles describing minority students were published in JCSP . 
JCP published a disproportionate number of papers about students' 
personality characteristics (48%); both JCSP and JEP devoted 20% of 
their articles to this topic. Seventyttwo percent of the manuscripts 
describing older students appealed in either NAWDAC or JCSP (x =78.27, 
df=20, , p < .01). About 44% of the 114 articles concerned with women 

- i . . ■ 

were published in NAWDAC . 

JCP , JCSP , and P&G together accounted for about three quarters of 
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thtf papers dealing with career and vocational development. JCSP 
devoted a relatively high proportion of articles to cogni* 
tive/intellectual (42%), socialtemotional (46%), , and moral development 
v64%) papers . . ^ • % 

Evaluation of instruction was a popular topic for JEP contributors 
as 42% of the articles on this topic were published in this journal; in 
fact, over 40% of all the college student research published in JEP 
wis related to this topic. Over 44% of the legal issues articles apt 
- peared in NASPA and comprised about 27% of all the college student 
^rticles in this journal. During the" 15 year period, only four articles 
about academic dishonesty were' published (Table 3); .three of these in 
JCSP . Papers cpncerned with specific out*of fclass behavior of students 
such as drug arid alcohol use and sexual activity were most likely to 
appear in JCSP , NASPA , and NAWDAC . . 

Almost three quarters of the articles wgj?4 categorized as_ either 
primarily (63.7%) or secondarily (10.8%). "descriptive" in nature. How* 
ever, the, proportion of descriptive articles ^decreased in the later 
years (Table 4). Theory development papers were the next most common 
(10.8% primary, 13.4% secondary). Relatively few concept integration 
(6.6%) and policy formulation (6.4%) papers were published; an annual 
average of six papers primarily devoted to concept integration and 
about three primarily devoted to policy issues. ^*Decisiontoriented 
papers were most 'likely to appear between 1975 through 1979; two thirds 
of tfhose were published during this five year period. t 

Articles with m characteristics of theory development were most 

likely to 'appear in AERJ> (57.8%), SocE (61.9%), and RHE (50%) 

2 f 

(x =261.60, df=20, p < .01). Policy oriented papers were concentrated 

. ' 20 "23 
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in JHE (13%), NASPA (12.6%), and NAWDAC (10-.5%)' (x =41.57, df=20, p < 

.01). Decisiontoriented research appeared most frequently in RHE (27J^ 

2 , . f ~~ 

and J CP (23.2%) (x -66.59, .df-20, p < .01). Developmental papers were 

' . 2 

more v likely . to, be found in NASPA (34.9%) and P&G (35.3%) (x =»13*.08, 
df=»2j0, p < .01). * , - 



Insert Table 4 aboup here 



Reviewers' expressed confidence in their ratings of the types of 
articles was not as high ad the estimated confidence levels for the. 
other categories^ nevertheless,' 86.9% of the ratings were^i the high 
and 12.5% in the* moderate confidence level range (Table 4)> 



Discussion 

The results of this study suggest that^ the college student research 
published in these 11 referreed periodicals has become more methodolo* 
gically sophisticated between 1969 and 1983. The use of anecdotal 
information seems to have decreased considerably, particularly in cer* 
tain., journals which in 1969 relied quite heavily qn^this type of. mater* 
ial. Although less sophisticated types of analyses (descriptive) have 
remained popular ^and^re often necessary for .certain purposes (e.g., to 
profile respondent pools) , these techniques were typically accompanied 
by univariate, and, in the later years covered by this stody, multivar* 
iate or some othej relatively sophisticated analytic techniques. The 
increased use of multivariate techniques is probably not unique to 
college student research but has also occured in other substantive 
areas in which social scientists conduct research. 



College student researchers" preference for pencil and paper in* 
strumentation remains firm; 1 however, the, use, of standardized 
instruments declined significantly in the .past 15, yeafs. in fact, the 
increased use of reliability estimates was probably a function of an 
increase in the use of locally developed instrumentation which requires 
evidence^ of rigorous psychometric properties £o convince editorial 
reviewers that the dataware valid and .reliable. Nevertheless, the 
frequency with which reliability measures are used is much 'less than 
the number of locally developed data collection tools. 

The reasons for a shift ,in preference from standardized to locally 
developed pencil and paper tools is not clear. Jt is possible that the 
topics of interest to researchers in the 1970s and 1980s dxich as eva 
uation of instruction and attrition are not readily amenable to t lie use 

* of nationally standardized tools* Also^ the emergence erf additional . 
theory bases require the construction of new instruments and more • 
sophisticated data analysis techniques. Thfese new instruments give the 
.college student researcher the best of two worlds. The instrumentation 
can be designed specifically to meet the needs of campus administrators 
(who, because of reduced federal support for such research <^j|tqd an 
increased interest in obtaining campus specific information that might 
be helpful in designing intervention strategies for reducing attrition 
are probably funding a greater proportion of colvLege student research). 

1 Also, pschometrically sound instrumentation which meets the 
researcher's specific purposes ' and can be easily revised without 
copyright problems . ' 

Unlike the 1960s, relatively few single sex samples were used in. 
the 1970s and 1980s. Sample sizes have increased slightly and prefer* 
ence has been shown by some journals ( 1EHE , AERJ , SocE ) for multiple 
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institutional^ samples or national data bases. Sirfgle institution and 
most multiple site studies' employed samples selected from state sup4 
ported PhD granting institutions; Only a handful of articles used 

t r ' ' ' ' " 

«*■ m ^^^^tL. ' ' ■ * * ■ • ■ 

students from coJjMpty college or baccalaureate granting institutions. 
Also, | ^£tively -few articles appeared during this 15 year period which 
focused on ethnic minorities such as Asian Americans, American Indians, 



and - Spanish sfairftiimed students. It is possible that such articles are 
more' likely , to( a^i^^^^necialty journals (e.g. , Bilingual Educator). 
Nevertheless^, ££he cc^ege experience of minority, students has .been 
effectively #i^^^d?in^iese h'igh circulation^eriodicals . 



;T$6 *".- 'ifelja tjLl^^t&i>in.<i r i t y of certain topics is not surprising given 
this issues' ViTh whid^^he academy has had to deal during the 1970s and 



eacly^ 1980s. / Jtesfa£»-^wtilc'h can represent a threat to institutional 
vitality a£i£. eYen-rsurMy^l such as faculty development and retention. 

probably * fi^&»^Mii^3|d the inquiries of some researchers. Authors 

• ■ '- ' ^i< f ^ 

also may jf,f$e seljgcfed topics in which they feel editors haye an 

interest. * \f 

•■• .i >. . ^* » 

It" i& surprising that some topics have not been addressed during 
thi^ time, at least not in these journals. Foe example, relatively few 
decjLsiontoriented papers devoted to the utility of special tutorial 



programs f q^> 6 .^^cationally disadvantaged students have appealed. 
Oespite the fact that members of national fraternity and sorority 
members comprise at least' 10*15% of the^Bfifergraduate population, only 
10 articles were pubJLifftied on this ttfpic ^rf^these journals during the 
entire 15 yea?:, period. Equally surprising was the paucity of research 
on academic dishonesty and commuter students, particularly those at two 

■"*• '. # 

year colleges. ' \ 
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Some of these topics are\clearly .norc^diffcicult td 'research. 



, Comimt^ -^gJtudents are more difficult to contact and those more likely 

fc-^U'-T 1 '- . >r\v . \-. .. .. 

fc^r^e ^i^^ritapt with them either JSx> not. have the interest in or. the 

pr^aiire "to gather the .kind of data necessary to be published in" these 

• .' ^ ••. 

journals. Illuminating the phenomenon of plagerism demands/ that" the 

■ * * . . ■ . - ■» . * 

student admit the- deed, an unlikely act. 

The results tend to confirm impressionistic* characterizations of 
the* vafious journals v> For example/ articles appearing in "research* 

oriented" journals such as AERJ and SocE £re characterized by relative* 

. \ ■ ~ . A 

ly large subject pools often from a national, data base and sophisti* 
cated metho4oXogical * land analytical jnrbcedures*. "Practitioner* 
oriented", journals such * as ■ NASPA , . NAWDAC , and J HE 'are more likely to 

ii . *»"*.' ' ' ' • ° ' 

publish papers less methodologically sophisticated for three reasons^ 
(a) their readers prefer narrative, not statistics,* (b) relatively few 

" ■ ■ • / N 

methodologically Sophisticated papers are submitted to these 
periodicals, and ..(c) editorial policies have been developed to ensure 
that published ^papers emphasize narrative over complicated methodology. 
Even though' sotmT methodologically complex studies are submitted to 
practitionertoriented journals, editorial policy requir^s^{J«rt before 
the raper will be published, much of -the methodology must be edited out 
or ./statistics carried in a" footnote* This probably serves to 41 sf 
courage some researchers from submitting certain kinds of material to 
some journals. It also placates association officers responsible for 
describing the benefits of journal subsdfrip£i6ns to prospective 
association member^. _ * . -j** * " . 

The topics common*? , to various^ journals seeing -to. be* generally 
consistent with the characteristics of the . professionals who hold 
membership in the associations which sponsor the periodicals. ^The 



American College Personnel Association sponsors JCSP and purports to 
champion the cause of human development in the academy. The 'majority 
of articles on this topic published between 1969 and 1983 appeared in 
this journal as have papers that' describe various subgroups of students 
(e.g., minority, older, comn^^fr students) often ignored Qr oveagfboked 
* by contributors to many other, journals. During this period, JEP and 
AERJ published n papers addressing a rather limited range of topics 
(i.e., achievement and evaluation of -instruction). However, these 
topics are at the core of the respective -sponsoring association's 
activities. We are what we say we are. One way to reinforce 
professional identity is to disseminate scholarship which reinforces the 
association's cause. These 11 journals exist for different reasons and 
clans of readers. The results of this study suggest their purposes are 
fairly distinctffat least on the substantive topic level. 

Given that about 160 papers about college students were published 
in .each of the last years, it is^furious that only a half dozen or 

sp primarily concept integration; .manuscripts appeared each year. 

\ . J 

Perhaps four percent of the papers published over a 15 year period is 
an adequate amount of synthesis. Concept integration is not an easily 
acquired skill; it requires insight and a familiarity with the 
literature most young scholars do not possess ancJ skills most graduate* 
programs do not address in coursework, assistantships, or dissertation 

: v . *. ■ ■ " . i ' 

work* Of , course, it is possible that the characteristics of concept 
integrations at* difficult to accurately identify; indeed, reviewers' 4 
level of confidence in their ratings' was lowest .when categorizing the 
type of article. It is also possible that ^he typology itself is not \ 
sophisticated enough to embrace the various manuscript styles that ha^P 



characteristics of concept ^integrations . 

This report is k general summary, of the preliminary findings -f rom 

\. ' * .' . .. ■ . * \ 

this study. Additional postthoc analyses will be conducted to respond 

to more specific quest ibns about zhe college student literature. For 

example, it might be interesting to compare the substantive topics and 

types of papers preferred by male and female authors and whether 

changes in editors resulted in changes in the types of papers that are 

subsequently published. 

Speculations 

As more sophisticated methodologies and ^palytic tools have been 
developed, more articles devoted to model testing or theory development 
have appeared aand the number of 'primarily descriptive articles has 

decreased. It is not clear from these data whether* the number of 

■ i 

- ■ ■ ■ * 

theory development articles has increased because more * theories *from 
which to choose are available, or because researchers are more 
competent in the use of the more sophisticated techniques required to 
develop and test theory. As with most shifts in practice, this 
emphasis on theory is probably a function of these and 'other social 
phenomena not completely understood. 

It is not known if the decrease in decisionforiented publications 
is a function of editorial policy, changes in the preferences of n&nu* 

0+ 

script reviewers or whether Tewe* such articles are being submitted for 
review. The fact that relatively few of these papers have appeared in 
the last three years compared with the period between 1975 and 1,979 is 
inconsistent with the "accountability" and "evidence of quality" 
slogans often expressed by external stakeholders and institutional 
decisionn^makers. . * . 



Assuming that the reviewers' inclusion decisions were consistent 
over the course of the study, the decrease in the number of articles 
devoted to college students published in >these 11 journals during this 
15 year period is curious. One hypothesis is that higher education 
researchers have turned'their attej|Hon to institutional strategy is4 
sues such as relationships with external constituencies and legisla* 
tors, alumni relations, and institutional planning activities. Without 
additional information, it is unclear whether this nu^prical decline is 
due in part to the emergence of specialty ( e.g. ^Association of College 
and University Housing Officers Journal ) or regional publications 
(e.g., College Student Affairs Journal , a publication of the Southern 
College Personnel Association) which publish articles about college 
students. 

The success of publishing companies focused on the higher educa* 
tion market probably has made it more lucrative for some scholars to 
prepare book length manuscripts. Certainly the "integrity of some 
topics such as Bowen's (1979) Investment in Learning and projects such 
as Astin's (1977) Four Critical Years and Chickering's (1975) Commuters 
Vs. Residents is best preserved in a medium which allows more compre* 
hensive treatment of the subject. Marketed to appeal to student af4 
fairs practitioners, -the New Directions for Studeq^Terfrfcses series- has 
contained several volumes on non*tradi£ional students. These other 
publication outlets have probably siphoned off some papers which 15 
years ago may have been prepared for one or more of the journals 
reviewed in this study. Whettfer the quality of the work disseminated 
by commercial publishers is the same as the material which must pass 
the scrutiny of journal teviewers cannot be determined from the results 



of this study. • 

While society has become more complex and multiple perspectives 
and' Interpretations of reality are becoming increasingly accepted 
(Schwartz & Ogilvy, 1979), it is somewhat disappointing that relatively 
few articles appeared between 1969 and 1983 in .which interview and 
observational data were used. Descriptions of the college student 
experience captured ethnographically can be as "valid" and as interest* 

ing as data gathered by psychometrically verified pencil and paper 

■ ' . * * ■ ,a ■ 

instruments. Such projects are often more labor ( "tesearcher") inten* 

slve and require more innovative use of electronic data processing 

equipment.* They ^lso are counter to the- trend toward larger, multi* 

site samples which surfaced in the 1970s. However, the results c^TMs 

study suggest that while much is known abou^ college students, most of 

this information has been collected and interpreted in the "analytical 

scientist" paradigm (Mitroff & Kilmann, 1978). Heeding Silverman's 

(1982) suggestion, perha ps our understan ding of college students could 



become richer and better balanced if more use were made of different 
inquiry perspectives such as those of the conceptual humanist and the 
particular humanist. * 

Conclusion 

While more methodologically sophisticated (e.g., increased use of 
multivariate techniques), the orientation to college student research 
has remained essentially the same between 1969 and 1983. The majority 
of studies employ pencil and paper instruments administered to 
relatively large combined gender samples. 

While it is safe to tconclude that a good deal is known about 

v> . 

college students in the United States, most of what is known is based 
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rant in 



students attending public, doctoral, granting institutions. Indeed, 
precious little^ is known about students atVtwa year, predominately 
commuter campuses, the sector in which growth in enrollment is 
increasing at the fastest rate. Not many articles, have been published 
about students at primarily baccalaureate granting . colleges. 

The college - student population continues to become more 
heterogeneous both in terms of demographics and aspirations (Keller, 
1983). Much of the research carried out using residential students may 
not apply to minority, older, parttime and commuter students. In* many 
respects, the need to learn more about college students has never been' 
greater. 



* 
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TABU 2 

Number of rArticlei about Colloge.Stiifenti Appearing in Selected Journals Between 1969-1981 



1569 • 1}7 1 1971 1975 197? i 1979 ^ jJJJ " MM-IMl 

Total College Total College Total, College Tot.l College fetal College Total College Totil College Total Ml*. Total of 

. StyJent I Stadeot I student . .student I 'student » StudSt ' . State! T J2dS "ISS** 
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WAWDAC 


40 ' 


30 


34 


15. 


■37 


12 


28 


7 


35 


14 


. 30 


11 


26 


«M 




101 


23 


90 


12 


91 


11 


^ 87 


11 


108 


16 


128 


18 


132 


12 


m < 


a 






a 


31 


17 ' 


35 


16 


49 


25 


- 50 


18 


43 


14 










a 




a 


a 






a 


16 


1 


.11- 


1 




22 


4 


18 


9 


23 


4 


26 


5 


21 


5 


17 


5 


26 


6 


Totals 


SI 8 


156 


5L9 


149 


581 


175 


579 > 


144 


571 


165 


583 


157 


572 


119 



46 


7 


267 


45 


16.81 


72 


36 


601 


366 


60.9t 


53 


11 


610 


125 


30.58 


83 


8 


769 


95 


12,48 


29 
30 


6 

12 


346 

'250 


77 

1 

103 
114 


22.28 
41.2) 


29 




259 


. 44.0$ 


141 


13 


160 


116 


13.21 


53 


6 


261 


96 


38.21 


25 


— 4 — 








sr 




k}%- 


18 


4 


173 


42 


24.31 


561 


122 


4467 


1189 


26.68 



Note: a « Journal was not published during these yean. 
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'. TABLE 2 

Frequency of Use of Data Analysis Techniques Used in 
College Student Research by Selected Journals 



Journal 


Descriptive 


Univariate 


4- 

- Multivariate 


Reliability 


Data 
Reduction 




Design 


Reviewers 1 
ConRdence Level 


AERJ 


40. OX 


17.8% 


62.2% , 


22.2% 


33.8% 


1 26,7% 


28.9% 


High 
Mod 


$7.0% 
3.0% 


JCgP 


71.0* 


60.1% 


19.5% 


3.6% 


4.1% 


56.3% 


18.6* 


High 
Mod 


91.4% 
8.6% 


JCP 


88. 8% 


82.4% 


29.6% 


8.8% 


•4.8* 


72.0% 


18.4% 


High 
Mod 


83.1% 
16.9% 


JEP 


78. 9* 


83.2% 


33.7% 


16.8% 


16.8% 


73.7% 


20.0% 


High 
Mod 


80.1% 
18.9% 

0 


JHE 


39.0% 

* 


26.0% 


13.0% 




2.6% 


32.5% 


9.1* 


High 
Mod 


75.9% 
24.2% 


NASPA 


28.2* 


12.6% 




2.9% 




26.2% 


2.9% 


High 
Mod 


96.9% 
3.1% 


KAWDAC 


44.7k 


18.6% 


.9% 




.9jT*V 


38.6% 


7.9* 


High 
Mod 


98.1% 
1.9% 


? & G 


33.6% 


9.5% 


.9% 


1.7% 




28.4% 


6.0* 


High 
Mod 


93.7% 
6.3% 




70.8% 


52.1% 


39.6% 


14.6% 


18.9% 


15.6% 


31.3% 


High 
Mod 


93.3% 
6.7% 




30.0% 


20 4. OX . 


20.0%— 


1Q.QX 


=^-.-10-rO%---,- 


20.0*= 
























— High" 
Mod 


10U70*~ 


>ocE 


61.9% 


16.7% 


19.0% 


9.5% 


9.5% 


21.4% 


42.9% 


High 
Mod 


100.0% 


aggregate 


% 59.7 


44.9 


19.1 


.6.1 


6.5 


47.9 


16.8 


High 
Mod 


91.1 
8.9 
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' TABLE 3 "'ijfc 

A Comparison of Substantive Topics Relal£fi v to College Students Appearinq 
in Selected Periodicals/Between 1969-1983 



Substantive Topic 



Behavior 



•-1975 „ 1977 
P .-. S P S 



1979 
P S 



1981 
P S 



1983 
P S 



Totals 
P S 



.2a 



Achievement 

Admission 

Drugs/Alcohol 

Attrition 

Cheating 

Sex 

Activities 

Characteristics 

Aptitude 

Aspirations 

Attitudes/Expect 

Commuters 

Ed. Disadvantaged 

Foreign 

Fraternity 

Graduate 

Handi capped 

Health/Sui cide 

Married 

Minority 

Older 

Personality 
SES 

Transfer* 
Vetera£s"l 
Women 

Development 



15 10 
2 2 



2 
5 

0 
11 



16 16 
6 1 
1 0 
6 

Y 1 
10 6 



12 13 
12 3 



A. 

8 i 



1 
1 
0 
2 
10 



13 


15 


4 


16 


4 


8 


5 


10 


4 


107 


69 


0 


2 


0 


3 


1 


. 1 


1 


3 


0 


34 




0 






4 


0 


2 


0 


5 


1 


27 


3 


2 


5 


1 


4 


4 


10 


1 


9 


0 


50 


18 




1 


0 






1 


0 






3 


1 


1 


2 


1 


2 


1 


1 


0 


3 


4 


15 


12 


2 


3 


2 


7 


4 


4 


2 


3 


2 


52 


27 



3 


4 


7 


4 


3 


12 


3 


3 


0 


3 


0 


2 


1 


3 


2 


• 

0 


19 
91 
210 


20 


13 


8 


3 


13 


7 


10 


6 


4 


6 


9 


3 


15 


4 


12 


3 


25 


6 


29 


10 


34 


H 


21 


8 


28 


16 


19 


9 


23 


3 


31 


3 


0 


1 


2 


0 


1 


0 






3 


1 


1 


4 


1 


0 


0 


2 


8 


1 


1 


4 


2- 


3 


1 


2 


1 ' 


0 


2 


2 


0 






2 


1 „ 


14 
14 


1 


0 


3 


0 


3 


1 






3 


0 


2 


1 






2 


0 


1 ' 
5 


0 


4 

1 


0 
2 


4 

5 


0 
0 


2 


0 


3 


1 


1 
3 


0 
0 


0 


1 


4 


0 


10 
23 










1 


0 






2 


0 


3 


0 


3 


0 


1 


1 


10 


2 


0 


1 


0 


5 


2 


2 


0 


2 


0 


1 


1 


3 


0 


2 


3 


18 


2 


0 


1 


1 


1 


0 


3 


0 


1 


1 


. 2 


2 


2 


0 






12 
82 


14 


1 


8 


0 


19 


1 


10 


2 


11 


2 


2 


1- 


10 


0 


8 


2 


2 


0 


3 


0 


3 


0 


3 


0 


6 


0 


9 


4 


3 


3 


12 


2 


41 
142 


21 


7 


28 


6 


25 


9 


14 


9 


17 


7 


11 


11 


9 


2 


17 


5 


1 


1 


5 


1 


2 


7 


. 2 


3 


2 


0 


1 


1 


1 


2 


1 


1 


15 


1 


0 


3 


1 


5 


0 


1 


1 


0 


1 


1 


0 


2 


0 


1 


1 


14 










1 


0 


2 


0 


2 


0 














5 


11 


2 


7 


4 


9 


3 


11 


3 


11 


4 


15 


1 


8 


0 


21 


4 


93 



31 
45 
66 
8 
8 
2 
0 
9 
1 
6 
4 
9 
9 
56 
16 
4 
0 
21 



22130 

23^17 

18*13 

24.41* 

11*20 

12*81 

14.90 



32.59** 
32.11** 
21.36 
21.12 
11.10 
10.89 
15.28 
24.58*^ 
19.18 
19.17 
18.82 
18.62 
42.65** 
20.50 
20.82 
12.87 
8.75 
26.66* 



Career/Voc 
Cognitive 



"Moral / e t h i ca 1 
Social/emotional 



Academi c 



11 11 




71 
24 
10 
46 



36 
26" 
15 
43 



35.75** 



33.14** - 
21.70 
38. 71** 



, Study skills 
Eval of ins true 

Mi scellaneous 



3 0 

4 1 



4 1 

5 0 



1 4 
9 3 



6 
16 



4 5 
15 0 



2 2 
18 5 



5 2 
5 1 



28 16 
80 11 



15.20 
35.84** 



Finances 
Learning styles 
Campus environments 
Legal issues 
"other" 

Confidence 
Level (X) 



High 

Moderate 
Low 



Note: °df = 14 
*p <.05 
**p <?.01 



3 3 
20 6 

3 8 
37 17 



2 
20 
17 
40 



81.4 86.1 
17.9 13.1 
.7 .8 



4 1 &2 
9 1 ^4 

16 10 15 
4 12 
40 13 



92.3 
7.6 



0 
4 

3 
1 

27 13 



83.1 
16.2 
.7 



6 1 
6 4 

14 10 
? 1 

19 13 



77.4 
21.3 
1.3 



2 


0 


1 


0 


1 


0 


16 


2 


17.44 


7 


2 


1 


0 


2 


1 


3 5 


15 


18.59 


11 


6 


5 


8 


2 


2 


io3 


47 


30.43** 


7 


0 


3 


0 


7 


1 


50 


13 


54.44** 


41 


29 


18 


11 


14 


6 


236 


111 


51.45** 



78. 5 
20.8 
. 7 



90.4 
9.6 



94.5 
5.5 



85.0 
14.5 
.5 
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Number of Various Types of College , Student Research* Articles and^ 
Reviewers' Level of Confidence in Ratings by Year _ 




Decision 
Oriented 

Developmental 



Confidence 
Level (%) 



ti£ie 


1969 




1973 


1975 


1977 


1979 


.1981 


1983 


Tola: 


Primary . 


114 


a 

97 


112 


' 92 


103 


85 


81 


73 


757 


Secondary*' 


* 10 


24 


29 


c 15 


17 


13 


5 


16 


129 


^Primary 


• 10 


15 • 


24 


17 


17 


14 


16 


16 


129 


Secondary 

•* • r 


' 20 


16 

< 


19 


25 


22 


15 


17. 


25 


159 


Prtfcmary ^ 


- 4 


6 


6 


6 


6 


8 


6 


8 


50 


Sicondar$5f 




2 


0 


1 


3 


5 


5 


5 


28 


Primary 


4 


8 


4 


1 




2 


1 


3 


28 


Secondary 


8 


8 


. 9 


5 


*5 


3 


3 


6 


47 


Prjguiry 




6 


4 


14 


,13 


24 


2 


3 


71 


5ec?|ftdary 


5 


7 


? 


13 


.14 


22 


5 


2 


77 




12 


12 


18 


14 


16 


f -11 


11 


12 


106 


Secondary 


5 


5 


10 


11 t 


* 7 

- *i- . 


/■ 13 


9 


15 


75 




89.7 


91.8 


98.7 


87.0 


81.3 


73.4 


88.5 


84.0 


86.9 


Moderate 




8.2 


1.3 


12.9 


16.0 


26.6 


11.5 


16.0 


12.5 


Low 










2.7 








^ .6 



x*(df=l4l 



38.95** 
19.76 
17.4T8 
15.32 

"i 

74.90** 
17.61 



**p < .01 



40 



ERIC 



